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Abstract 

We investigate the following questions: Given a measure pA on 
configurations on a subset A of a lattice L, where a configuration is 
an element of for some fixed set P, does there exist a measure p 
on configurations on all of L, invariant under some specified symme¬ 
try group of L, such that pA is its marginal on configurations on A? 

When the answer is yes, what are the properties, e.g., the entropies, 
of such measures? Our primary focus is the case in which L = 
and the symmetries are the translations. For the case in which A is 
an interval in Z we give a simple necessary and sufficient condition, 
local translation invariance (LTI), for extendibility. For LTI measures 
we construct extensions having maximal entropy, which we show are 
Gibbs measures; this construction extends to the case in which L is the 
Bethe lattice. On Z we also consider extensions supported on periodic 
configurations, which are analyzed using de Bruijn graphs and which 
include the extensions with minimal entropy. When A C Z is not an 
interval, or when A C Z*^ with d > 1, the LTI condition is necessary 
but not sufficient for extendibility. For Z'^ with d > 1, extendibility is 
in some sense undecidable. 
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1 Introduction 


We consider an extension problem for measures describing configurations on 
a lattice L, in which the value r]i of the conhguration r] at site (or equivalently 
vertex) i of L belongs to some hxed set hi. Let X = be the set of all 
conhgurations on L and, for A C L, let Xa = be the set of conhgurations 
on A. Then we address the following extension problem; for a hxed A C L 
and probability measure on Xa, does there exist a probability measure fi 
on X such that (i) /i is invariant under some specihed group of symmetries of 
L and (ii) the marginal measure of /i on Xa is /ta? When fi exists we speak 
of it as an invariant extension of /xa or, since we consider only invariant 
extensions, simply as an extension. In this case we say that /ia is extendible. 

For most of this paper the lattice L will be taken to be for some 
d > 1, and the symmetries of interest will be translations or, occasionally, 
translations plus rehections about a coordinate axis. In this case we will 
refer to an invariant extension /i as a T/ extension or, as above, simply as an 
extension. In Section 3 we discuss the case in which L is the Bethe lattice. 

A. G. Schlijper [27]-[30] studied the problem of TI extensions on 1/ in the 
1980’s, in connection with its application to the eluster-variation method [22], 
used to obtain approximations to the equilibrium thermodynamic properties 
of lattice systems. The problem was also studied by Pivato [24] in 2001 and 
by Chazottes et al. [ 6 ] in 2012. For completeness we will summarize or 
rederive some of the results of these papers in the course of describing our 
own work; we discuss this in more detail at the end of this section. 

For A C Z*^ we say that measure on Xa is locally translation invariant 
(LTI) if for any subsets A, A' C A, with A' a translate of A, the marginal 
of /iA on Xa' is the translate of the marginal on X^. The LTI property is 
clearly necessary for the existence of a TI extension fi of ha and one question 
we investigate is whether or not it is also sufficient. 

From now on we will assume that, unless otherwise stated, A is hnite. Our 
primary focus will be the case in which O is hnite. Our results then do not 
depend signihcantly on the cardinality of O; for simplicity of presentation 
we will often take O to be {0,1}, so that a conhguration 77 G X may be 
thought of as describing a particle system or point process on the lattice. We 
will occasionally point out instances in which our results extend to certain 
inhnite O. 

For hnite G we have a good understanding of the situation when d = 1 
and A is an interval. In particular, the LTI condition is in this case sufficient 
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for the existence of the TI extension [29, 24], as we verify in Section 2 by 
an explicit construction of such an extension; the resulting p is in fact the 
unique TI extension which maximizes the entropy of its marginal on X\i 
for any interval A' D A. Moreover, if A contains k + 1 sites then fi is the 
shift-invariant measure on the sample paths of a /c-step Markov process, and 
as such is a Gibbs measure with TI interactions which have range at most 
k and involve at most k + 1 sites. We obtain an explicit expression for the 
Gibbs-Shannon entropy of pA' as an affine function of the size of A'. This 
extension method applies also when A is an inhnite strip in or a higher 
dimensional analogue of such a strip, or is one of a certain class of subgraphs 
of the Bethe lattice which are analogous to intervals in Z. 

In the one-dimensional case, with A an interval, G finite, and pa LTI, 
there exist also TI extensions of pA which are supported on a hnite number 
of periodic conhgurations [6]. We discuss this and related results in Sections 4 
and 5. Every TI measure of this type has hnite entropy, in a sense which 
will be made precise later, and we show that every extension with minimal 
entropy is of this type (there is in general no unique minimal entropy exten¬ 
sion). However, for general pa we are not able to give an explicit construction 
of a minimal entropy extension or even to determine the minimal entropy, 
although we do give an a priori bound for the latter. A key element of our 
analysis here is the identihcation of a measure on Xa with an edge-weighting 
of a de Bruijn graph; the LTI condition on the measure then corresponds to 
current conservation at the vertices of the graph. 

When one passes to the extension problem for A not an interval of Z 
the situation is more complex. In Section 6 we give simple examples of LTI 
measures /ta which are not extendible; for example, with A = {i, i + 1, i-|-3} C 
Z and A a unit square in 7? (with four lattice sites). For the latter example 
it is relevant to remark that when A C Z^ is a product of intervals, and 
is LTI, the maximal entropy extension procedure mentioned above can be 
used to extend pA in one direction, i.e., to an inhnite strip, and the resulting 
extension is TI in the direction of extension. In this process, however, the 
LTI property in the second direction may be lost; only if it is preserved can 
one repeat the process to obtain an extension to all of 7?. Similar remarks 
apply in higher dimensions. 

As noted above, when G = {0,1} we are studying point processes on 7^. 
In this context the current paper may be viewed as continuing work on a 
long-standing problem: the existence of point processes when one is given 
partial information about the desired process (see, for example, [23, 7, 31] 
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and further references given in [17]). In our own previous work [15, 4, 16, 
17] we considered the case in which the information given was all /c-point 
correlation functions of the process up to some order /cq; this is in essence a 
truncated moment problem. Extending the work of [1] we obtained a sufficient 
condition, essentially one of low density, for the existence of the process. 
Complete necessary and sufficient conditions were found in [17]; these are 
worked out in detail for the case ko = 2, but the method is general. See also 
[18], 

We hnally note that, for fixed A C Z'^, the set of measures pA on X\ which 
can be extended to a TI measure on Z'^ is closed in the weak topology. For 
if (AA,n)[?Li is a sequence of measures on Xa converging weakly to a measure 
Pa, and jin is a TI extension of pA,n to X, then some subsequence of {finjjjLi 
will converge, by compactness, and the limit will be a TI extension of pA- 

The outline of the rest of the paper is as follows. In Section 2 we show that 
the LTI condition is sufficient, when A is an interval in Z, for the existence 
of a TI extension; we do so by explicit construction of the maximal entropy, 
Markovian, extension. We also point out that this extension is Gibbsian. In 
Section 3 we take up the extension problem on the Bethe lattice; there also 
we construct maximal entropy extensions which are Markovian and Gibbsian. 
In Section 4 we return the the case in which A is an interval in Z and discuss 
a different class of extensions, those supported on periodic conhgurations, 
and in Section 5 show that these include the extensions of minimal possible 
entropy. In Section 6 we give several examples to show that, in Z*^, the LTI 
condition is not sufficient for extendibility when A is not an interval in Z; we 
give also a corresponding example for the Bethe lattice. Section 7 takes up 
the issue of the decidability of the extension problem. 

We hnally discuss briehy the overlap of this paper with other work. As 
noted above, the Markovian extension of Sections 2 and 2.1 has been dis¬ 
cussed before, see in particular [29, 24], although its Gibbsian nature has 
not been noted. Periodic extensions are discussed [24, 6], and our results in 
Section 4 partially overlap with this work. Our discussion of the Bethe lat¬ 
tice in Section 3 is, we believe, new, as is the discussion of minimal entropy 
measures in Section 5. Examples 16 and 17 of Section 6 are new. Aspects 
of undecidability for the extension problem in higher dimensions have been 
discussed in [30, 24, 6], but we give a formulation that we feel has something 
new to offer. 
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2 Maximal entropy extensions in one dimen¬ 
sion 


We will adapt the general notation of the introduction to the one-dimensional 
case considered in this and in Sections 4 and 5 by letting A^., for /c > 0, be the 
subset {0,1,, k} of Z, = {0, be the set of particle conhgurations 
on Afc, and for /i a measure on X or on Xj with j > k, be the marginal 
of /i on Xk- We suppose that we are given a LTI measure jik on X^ and 
construct explicitly a (TI) measure /i on X = {0,1}^ which extends i-e., 
satisfies yr^/i = /ifc- 

We will usually invoke the condition that is LTI as the requirement 
that the marginal /ik-i = of Hk on Xk-i be the translation of the 

marginal on conhgurations on the sites {1, 2 ,..., k}\ 

k'k—lijlOi ■ ■ ■ 1 hfc—l) ^ ^ k'kijlOi ■ ■ ■ 1 Vk—li 

a=0,l 

= ^ f^k{(T,V0,---,Vk-l) ( 1 ) 

o-=0,l 


We say that j^k is symmetric if it is invariant under rehections about the 
center of A^. It is easy to verify that if is LTI and j < k then the 
marginal of j^k on Xj is also LTI, and if yik is also symmetric then so is this 
marginal. In fact, a symmetric measure is LTI if and only if its marginal 
on Xk-i is symmetric. 

We begin the construction of /i by extending jj,k to a LTI measure jik+i 
on Xfc+i, dehning /ifc+i(77o, r/i, • • •, %+i) = 0 if /ifc-i(?7 i,..., ? 7 fc) = 0, and 


Afc+i(ho,hi) • • • ;hfc+i) — 


k'kivo, Vi,---, Vk)^k{vi, Vk+i) 

k'k—lijlli ■ ■ ■ 1 hfc) 


( 2 ) 


otherwise. One verihes easily that fj-k+i is LTI and has marginal Hk on Xk- 
Moreover, if is symmetric, so is fik+i- This leads immediately to the main 
result of this section. 


Theorem 1 If ^k is a LTI measure on Xk then there exists a TI measure /i 
on X which extends Hk- Moreover, if fik is symmetric then n may be taken 
to be symmetric under any reflection. 

Proof: Suppose A = {—/, —/ -f- 1,..., j} with I > 0 and j > k. By the 
repeated application of (2) (and a translation) one may hnd, for any I and 
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j, a LTI measure fi\ on {0,1}^ whose marginal on is The result 

then follows from the Kolmogorov existence theorem. The preservation of 
symmetry is immediate. ■ 

There is another approach to this extension procedure. Equation (2) can 
be written as 

h'fc+l(hO) ■ ■ ■ 1 Vk+l) h'fc(hO) Vli ■ ■ ■ 1 Vk}f^k{vk+l I ■ ■ ■ Vk)i (3) 

where the conditional probability /ifc(Cfc I Co; • • • Cfc-i) is dehned to be zero 
whenever ■ ■ ■ Cfc-i) = 0, and then one sees that the extension proce¬ 

dure described in the proof of Theorem 1 is equivalent to 

j-k 

= ^^k{^lo, ■ ■ ■ ,^lk)W^^k{^li+k I Tii,---,Vi+k-i)- (4) 

i=l 

Equation (4) says that we may regard the extension procedure as dehning a 
Markov chain with state space {0,1} having memory, for which the transition 
probabilities depend on states at the previous k — 1 time steps. The TI 
extension /i of fik given in Theorem 1 is then just the invariant measure on 
sample paths for this chain. Equivalently one may think of a 1-step Markov 
chain with state space 

Remark 2 It is sometimes convenient to use spin notation rather than par¬ 
ticle (i.e., lattice gas) notation in describing conhgurations in or X. As 
usual if ?7 is a particle variable taking values in {0,1} we introduce a cor¬ 
responding spin variable a = 2?7 — 1 taking values in { —This is 
convenient in particular because it permits us to write a measure /i^ directly 
in terms of the corresponding spin correlations: 

... ,(Tk) = ^ (o-a)ctaY (5) 

AcAk,A¥=<ll ^ 

where as usual cta = HiGyi the spin correlation (cta) denotes the ex¬ 

pectation fiki^'A) of o'A in the measure /i^. One may think of the expectations 
((Ja) in (5) as parameters which determine the measure; the condition that 
/ifc be LTI is simply that (cta) = {ub) whenever R is a translate of A. Note, 
however, that in using the form (5) to constrnct a measure with certain 
given (a^) one must check that it assigns nonnegative probability to each 
conhguration. 
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Remark 3 (a) If is any finite set then everything said above extends im¬ 
mediately to measures dehned on As an example, take hi = {0, so 
that may be identihed with the space {0, of particle conhgura- 

tions on a kxm rectangle. If such a measure is LTI under translations in the 
horizontal direction then it may be extended by an obvious generalization 
of (4) to a measure on conhgurations on A x A^, where A is any interval 
containing A^., and hence to a measure on conhgurations on Z x A^ as in the 
proof of Theorem 1. However, even if the original measure is also LTI in the 
vertical direction, this extension procedure need not maintain the LTI prop¬ 
erty for translations in the vertical direction. Example 16 (see Section 6) is 
of this nature: an extension from the original 2x2 square to a 3 x 2 rectangle 
destroys the vertical LTI property. 

(b) The extension method in the Markovian form (4) is well dehned for 
a large class of spaces it suffices that the fj-kiVk \ Vo,---Vk-i) be well 
dehned (regular) conditional probabilities. This will be true, for example, 
if H is a complete separable metric space [2] or, essentially equivalently, a 
standard Borel space [9]. Consider, for example, a LTI measure for a strip 
in 1?, that is, a LTI measure on {0, = (^{Q, 1}^)^™; since {0,1}^ is a 

standard Borel space we may then use (4) to extend vertically to a measure 
on conhgurations on {0,1}^^. In this context the original measure might 
be obtained by beginning with a LTI measure on a rectangle {0, 
and making the maximal entropy extension in the horizontal direction. As 
noted above, in general the LTI property in the vertical direction will not be 
preserved by this extension, but if it is, the above remarks apply. 

2.1 Entropy 

Let us denote the Gibbs-Shannon entropy of a probability measure /i on a 
discrete set Q (typically for us a set of conhgurations) by S(ju): 

=-'^M^ogp(g). ( 6 ) 

q&Q 

The entropy of the extension pj given in (3) or (4) is easily found to be 

S{nj) = S{iik) + U - k)[S{iik) - j>k. (7) 

Now recall the strong subadditivity inequality for entropy [20]: if /x is a 
probability measure on a product Q = Qi x Q 2 x then the marginal 
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measures /ii 2 , 1 ^ 23 , and 1^2 on Qi x Q 2 , Q 2 x Qs, and Q 2 , respectively, satisfy 

^(/i)<^(M + *^(M-*^(/^2). (8) 

(i) 

This implies that if Uj is any measure on Xj for which the marginal z/j on 
{0 ,1 satishes 

iyf\vh---,Vi+k) = f^k{Vi,---,Vi+k), i = 0,l,...j-k, (9) 

then S'(z/j) is at most equal to the right hand side of (7). Thus fij is in fact 
the maximal entropy extension of /i^ to Xj under the constraint (9); there 
is a unique such extension by the strict concavity of the entropy. Note that 
satisfaction of (9) is necessary for Uj to be LTI but is not sufficient, since 
it does not impose translation invariance for sets of diameter greater than 
k + 1. Nevertheless, we know from Theorem 1 that the measnre /ij, which 
maximizes the entropy nnder only the constraint (9), is LTI, so that the same 
measnre would be obtained by maximizing the entropy over all LTI measures. 

2.2 Gibbs measures 

Now suppose that /i^ does not assign zero probability to any conhguration. 
Then it is easy to see that the Markovian extension on X provided by 
the proof of Theorem 1 is an inhnite volnme Gibbs state (see [26] for dehni- 
tions and results) for the translation invariant interaction energy U dehned 
formally by 

U{v) = ^^{Vi,---,Vi+k), hex, (10) 

where the interaction potential <h is given by 

^{r]o, ...,r]k) = - InfXkiVk | ho, • • • ,hfc-i)- (H) 

If Hk assigns zero measure to some conhgurations then the same argnments 
and conclusions apply. We may either simply allow for the interaction <h to 
sometimes be +cxd and consider the corresponding Gibbs states, or we may 
follow [26] and restrict the allowable conhgurations to those whose restriction 
to any interval of k + 1 sites has nonzero probability nnder /i^. 

Gonversely, snppose that one starts with a TI measure u on X which is a 
Gibbs state for some interaction potential with interactions of range at most 
k; again we may allow the interaction potential to take the valne +cxd or 



alternatively may restrict the allowable configurations by local constraints of 
range k. The marginal of u on will then be LTI. Since u is Gibbs, it 
is Markovian of range k [26] and hence agrees with the Markovian extension 
of z/fc to X provided by the proof of Theorem 1. Note that the original 
interaction in terms of which z/ is defined need not agree with the interaction 
(11) naturally associated the Markovian extension procedure applied to z/^; 
the same Gibbs measure will arise from different interactions if they give the 
same answer, up to a constant, when they are used to compute the energy 
in a finite volume with boundary condition (the constant may depend on the 
boundary condition) [10, Section 2.4], 

3 Extension of measures on the Bethe lattice 

As discussed in Remark 3(a) above, the Markovian extension technique of 
Section 2 does not in general yield extensions of measures in higher dimen¬ 
sions. It does do so, however, on the Bethe lattice. To discuss this we fix 
g > 1 and let T denote the (infinite) Bethe lattice in which every vertex has 
degree g -|- 1. For a subgraph of T we may then consider a measure on 
Xh = and ask for an extension to X = which is invariant under the 
group of all isomorphisms of T. Again there is an obviously necessary local 
invariance (LI) condition for the existence of such an extension: that if Hi 
and H 2 are connected isomorphic subgraphs of H, with 0 : i^i —)■ 7^2 an iso¬ 
morphism, and Vj is the marginal of fin on Xh-, then the induced mapping 
0* of measures satisfies 0 *z /2 = z/i. 



k = 0 k = 1 k = 2 k = 3 k = A 


Figure 1: Full subgraphs of diameter k, /c = 0,..., 4, when g = 2. 

A special role in what follows will be played by full subgraphs of T: the 
maximal subgraphs of with fixed diameter k. Any two such are isomorphic 
(see Figure 1). When k is even, such a full subgraph has (g-l-l)-fold symmetry 
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about a central vertex; when k is odd, it has 2-fold symmetry across a central 
edge. We £x some vertex uq in T and some edge Cq incident on it, and for 
k = 0, 1 ,... let Tk denote the particular full subgraph which has central 
vertex vq if k is even and central edge cq if k is odd, so that in particular 
To C Ti C ■ ■ ■ . We abbreviate Xtj. as If g = 1 then the Bethe lattice T 
is just Z and is the interval Kk oi k + 1 sites. For general q the graphs 
Tfc play a role for extensions to T similar to that of the for extension to 
Z: when one begins with an LI measure on Xk there is no obstruction to 
extension. 

Theorem 4 Let fXk be an LI measure on T^, k = 0,1,.... Then /i^ has an 
extension to an invariant measure fr on X. 

Note that, because the invariance we consider for T is invariance under 
all isomorphisms, the q = 1 case of Theorem 4 corresponds to the case in 
Theorem 1 of symmetric extensions of symmetric measures. 

Proof of Theorem 4-' We first extend Hk to a measure Hk+i on T^+i, in doing 
so we will need only two consequences of the local invariance of Hk'- (i) hk 
is invariant under automorphisms of Tk, and (ii) the marginal of /i^ on Xk-i 
is invariant under automorphisms of Tk-i- (In fact, (i) and (ii) imply local 
invariance, but we do not need this.) Tk+i contains copies Tf,... ,Tf'‘ of 
Tk (one of which is Tk itself), where = 2 if /c is even and rk = q + 1 ii k 
is odd, and these intersect in Tk-i- From (i) it follows that we may speak 
without ambiguity of the copy ir\ of Hk on T^, and from (ii) that the marginal 
of any on Tk-i is independent of i. Then the extension formula is 

rk 

hk+liv) = 

i=l 
rk 

= Tk{VTk.^)YlTl{VTl\Tk.^ I VTk.^) 

i=l 

where for r] G Xk+i we have written rjH for the restriction of rj to any subgraph 
H of Tfc_|_i. Note that (12) is a direct generalization of (2), while (13) is a 
symmetrized version of (3). 

It is easy to see that Hk+i is indeed an extension of jj,k- Moreover, it 
again satisfies properties (i) and (ii); (i) follows from the fact that any auto¬ 
morphism of Tk+i will permute the Tl and preserve Tk-i, and because Hk+i 
extends /i^, (h) is an immediate consequence of property (i) for Hk- Thus we 


( 12 ) 

(13) 
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may apply the above construction repeatedly to extend to any Xj with 
j > k, maintaining properties (i) and (ii) at each step, and thus obtain the 
extension /r on X as a limit, /i is invariant under the group G of isomor¬ 
phisms of T, because, as is easily seen, G is generated by the subgroup G^^ of 
G of isomorphisms that £x the central vertex uo, together with the subgroup 
Geo of isomorphisms that fix the central edge Cq, and invariance of fi under 
these subgroups follows from properties (i) and (ii) of the finite extensions. 


Remark 5 There is an alternative but equivalent version of the last step of 
this proof, that is, of the extension beyond X^+i- The procedure is of course 
again inductive; we consider the extension from Xj to X^+i, j > k + 1. One 
obtains Tj+i from Tj by adding q new edges and vertices to each vertex v in 
a certain subset Vj of the vertices of Tj of degree one. Each such v, together 
with the new edges and vertices attached to it, is part of a unique copy 
of Tfc in Tj+i, and the extension is 

fij+iiv) = n I VH-), (14) 

where O Tj. Thus the distribution determined by fij+i on the new 

vertices attached to v depends only on the configuration in . From this 
it follows that the distribution on the complement of any Tj which arises 
from conditioning the extension on the configuration in Tj, actually de¬ 
pends only on the configuration on vertices of Tj a distance at most k from 
the complement. In this sense the extension constructed here is maximally 
Markovian. 

It is straightforward to calculate the entropy of these extensions, through 
the recurrence 


S{fij+i) = S{fij) + {Tj - l)[5(/ij) - S{^j_i)], (15) 

where Hk-i is the marginal of /i^ on Xk_i. For q = 1 the entropy grows 
linearly with q; see Section 2.1. For q > 2, S{fij) grows as for large j; 
more specifically, with AS = [S{fik) — 5'(/ifc_i)] we find that for j > k and 
p = [{j — k + 1 — {k mod 2))/2j, 

S{p,) = S{pk) + (16) 
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A simple calculation shows that the entropy per site is asymptotically con¬ 
stant, and an argument as in Section 2.1 implies that (16) is the maximum 
possible entropy of any extension. 

The considerations of Section 2.2 apply here essentially unchanged; in 
particular, the measure on T constructed here is Gibbsian with interaction 
potential 

^(hrj = -\nfXk{riT,\T,_, \ Vn_,)- (17) 

4 Periodic extensions in one dimension 

We now turn again to the study of TI extensions io X = of an LTI 
measure dehned on the space of conhgurations on the interval A^. 
We consider in particular extensions which are of a different character from 
the maximal entropy extensions considered in Section 2: those supported 
on periodic conhgurations in X. We will call such a measure a periodic 
configuration (PC) measure. Within the class of PC measures we single out 
the basic periodic configuration (BPC) measures: a BPC measure is obtained 
from a particular p-periodic conhguration by giving weight 1/p to each of its 
p translates. The set of PC measures is clearly convex and its extreme points 
are the BPC measures; since the set of BPC measures is countable, every PC 
measure u has a representation 

^ = ^ CoZ/o, Ca>0, ^ c„ = 1, (18) 

where the sums run over the set {r'a} of all BPC measures. 

In this section and the next we will for simplicity consider only the case 
of particle conhgurations, i.e., = {0,1}; the extension of the results to any 

hnite is straightforward. We will write a conhguration r] G as a string 
VoVi ■ ■ - Vk (rather than as a (/c-l- l)-tuple (?7o,..., rjk)) and will similarly write 
?7 G X as a doubly inhnite string; since we do not use any products of the rg 
no confusion should arise. 

4.1 BPC and extremal LTI measures on 

Let Mk denote the set of all LTI probability measures on X^; is mani¬ 
festly a convex polytope. Since the LTI condition (1) and the normalization 
YlrjeXk hfe(h) = 1 represent 2^ independent constraints on the 2^^^ variables 
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f^kiv)^ V ^ ^k, Mk has dimension 2^. We wish to characterize the extreme 
points of this polytope. We will say that a periodic conhguration t] E X 
and the corresponding BPC measure z/ supported on the translates of r] are 
k-primitive if no segment of length k is repeated within one (minimal) period 
p of ? 7 , that is, if 77 * 77 *+! ■ • ■ 77 *+fc_i = 77 ^ 77^+1 ■ ■ ■ Vj+k-i only when j - 7 is a mul¬ 
tiple of p. Note that then p <2^. We will prove shortly, using the concept of 
a de Bruijn graph, that the extreme points of are precisely the marginals 
TTfcZ/ with u a /c-primitive BPC measure. 

The (binary) De Bruijn graph of order k > 1 (or sometimes dimension 
k) [ 8 , 12 ], Gk, is the directed graph with 2 ^ vertices and 2 ^+^ edges, labeled 
respectively by all binary strings of length k and length k + 1, in which for 
any binary digits a and b and binary string 6 of length k — 1 the edge aOb 
runs from vertex ad to vertex 9b (see Figure 2). Note in particular that 
Gk contains two loops, labeled respectively by 00 ■ ■ - 0 and 11 ■ • • 1 , but no 
multiple edges. Since the edges of Gk are labeled by the elements of Xk, it is 
clear that any probability measure p,k on Xk corresponds to an assignment of 
a nonnegative eurrent to each edge 77 of Gk in such a way that = Ij 

the correspondence is of course via j*, = /ifc({ 77 }). The terminology “current” 
is appropriate because one checks easily that pk is LTI if and only if the 
current is conserved at each vertex of Gk, that is, if for each vertex ^ the 
sum of the currents on the two edges entering ^ is equal to the sum of the 
currents on the two edges leaving (Such a current assignment is called a 
eireulation in the theory of graphs.) 

Suppose that P is a closed path in Gk, that is, a sequence of |P| edges 
rjk^f ..., 77 ( 1 ^ 1 ) in that order (possibly with repetitions), and that V is minimal 
in the sense that there is no shorter closed path V' such that V is obtained by 
tracing P' several times. Each rj^^l is a string oik + 1 symbols (see Figure 2), 
and we may obtain from V a periodic conhguration by tracing V repeatedly, 
recording the hrst symbol on each edge encountered: with rj^^^ = ■ ■ ■ rj^^ 

this conhguration is • • ■ 77 q^'^77q^^ ■ ■ ■ ■ ■ ■ E X. Let U'p denote the BPC 

measure associated with this conhguration; the map V eE- v-p establishes a 
bijective correspondence between minimal closed paths and BPC measures. 
As usual a eyele C in Gk is a closed path with no repeated vertices; a loop is 
considered to be a cycle. 

Theorem 6 The mapping C ^ vc gives a bijective correspondence between 
the cycles in Gk and the k-primitive BPC measures on X. The extreme points 
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Figure 2: The De Bruijn graphs Gi, G 2 , and G 3 . 


of Mk are precisely the marginals Tr^z^C; with C a cycle in Gki equivalently, 
every LTI measure /ifc on Xk has the form nkV, where u is a (finite) convex 
combination of the k-primitive BPC measures uq. In particular, every such 
/ifc has an extension to a PC measure. 

Proof: The condition that a cycle C contain no repeated vertices is precisely 
the condition of /c-primitivity on vqi and the bijective nature of the corre¬ 
spondence C -H- z/c is clear. If |C| = p then the measure tt^z/c gives weight 
1/p to each edge of C and weight 0 to all other edges, and is thus clearly an 
extreme point of M^. Conversely, given an element p,k G M^, the set of edges 
7] of Gk for which pikipi) > 0 must by current conservation contain a cycle C, 
say of length p, and if a is the smallest current assigned by jXk to any edge 
of C then we may write 

1 

Pfc = {pa)nki^c + (1 - pa)fvl, where fvl = - -(pfc - pankUc), (19) 

1 — pa 

thus representing pik as a convex combination of the LTI probability measures 
uc and We may apply the same construction to and by repeating this 
process obtain a representation of p^ as a convex combination 

hfc = ^/^C'TI'fcZ^C, = (20) 

c c 


1 

14 


as required; the process must terminate because fil as defined by (19) gives 
zero probability to at least one more configuration than does fi. ■ 

Remark 7 (a) It is known [11, 21] that Gk contains cycles with every length 
p satisfying 1 < p < 2^. In particular, Gk contains two cycles of length 1, 
the loops mentioned above, which correspond to the two period-one config¬ 
urations in X, and 2*^^*’ cycles of length 2^ [8]. 

(b) Although it follows from (a) that Mk contains at least 2*^^ extreme 
points, a result of Caratheodory [13, 5] implies that, because Mk is of dimen¬ 
sion 2^, every LTI measure pk can be written as a convex combination of at 
most 2^ -|- 1 measures Tiki^c- 

4.2 Extensions of LTI measures to a ring 

Let denote the ring (one-dimensional discrete torus) with L sites: = 

{0 ,..., L — 1}, with translation defined via periodic boundary conditions. 
Rather than considering extensions of pk to TI measures on X one may 
instead ask whether there exists an integer L > k + 1 such that pk has an 
extension to a TI measure on Yl = {0,1}^^, the set of configurations on 
Z^, and, if so, for what values of L this is true. The first question is clearly 
equivalent to that of whether there is an extension to a measure z/ on Z which 
is a convex combination of a finite number of BPC measures; if so, L may 
then be taken to be the least common multiple of their periods. Theorem 6 
implies that the answer is affirmative; here we discuss a few questions abont 
the valnes of L. 

Theorem 8 The smallest integer L > k + 1 such that every LTI measure on 
Xk may be extended to a TI measure on Yl is 

Lo{k) = \cm{l,2,3,...,2’^-l,2’^}. (21) 

Proof: Snppose that L > k + 1. It is easy to see that the measure uq, 

with C a cycle in Gk, can be extended to a TI measnre on Yl if and only 
if \C\ divides L, and from the representation (20) it follows that every LTI 
measnre on Xk can be extended if and only if L is divisible by \C\ for every 
cycle C. The result (21) now follows from Remark 7(a). ■ 

Theorem 8 does not address the natnral question of the minimal value of 
L, or of all possible values of L, for the extension of a given measnre pk- We 
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will not try to give a general discussion of this matter, but rather content 
ourselves with discussing two examples. 

Example 9 Suppose that we begin with a measure pi dehned on two sites. 
The De Bruijn graph Gi has three cycles Co,Ci,C 2 (see Figure 2), where 
Co and Ci denote the loops 00 and 11 respectively, and C 2 the cycle with 
edges 01 and 10 , so that with coefficients in the simplex 

S = {(co,Ci,C 2 ) I Cj > 0, ^2^=0^ = !}• hi has a TI extension to Yl for any 
even L, since the measures corresponding to the three extreme points (1, 0, 0), 
( 0 , 1 , 0 ), and ( 0 , 0 , 1 ) of S have extensions which give respectively probability 
one to 0 ^, probability one to 1 ^, and probability one half to each of ( 01 )'^/^ 
and ( 10 )^/^ (where for any hnite binary string rj, r]'^ denotes the concatenation 
of n copies of 17 ). If L is odd, say L = 2^ + 1, then pi has an extension to 
Yl if and only if C 2 < 1 — 1/T. For the measures corresponding to the four 
extreme points ( 1 , 0 , 0 ), ( 0 , 1 , 0 ), ( 1 /T, 0 , 1 — 1 /T), and ( 0 , 1 /L, 1 — 1 /L) of 
S n {(co. Cl, C 2 ) I C 2 < 1 — 1 /T} all have extensions to Yl] the hrst two are as 
above and the remaining two give probability 1/Lio each of the L translates 
of 0(01)^ and 1(01)^, respectively. Conversely, if L is odd and pi has a TI 
extension to Yl then the fact that every conhguration in Yl contains either 
two consecutive I’s or two consecutive O’s implies that Cq + Ci > 1/L. 

Example 10 If /i^ is supported on a union of vertex disjoint cycles (and gives 
positive probability to each) then an analysis as in the proof of Theorem 8 
shows that /ifc has an extension to Yl if and only if L is divisible by the 
least common multiple of the lengths of these cycles. The maximal length 
of a cycle is 2^ (see Remark 7(a)), but this least common multiple may 
be much larger. Using Maple, we hnd that for k = 1, ..., 7 the maximum 
value Lk of this least common multiple, taken over all collections of vertex 
disjoint cycles, is as given in Table 1; there the factorization corresponds 
to the lengths of the maximizing set of cycles. In all of these cases except 
k = 3, Lk = ( 7 ( 2 ^), where g is Landau’s function [19]: g{n) is the maximum, 
over all partitions {ni,..., of n, of lcm{ni,..., Uq). Landau showed that 
log g{n) ^/n\ogn for large n. We do not know whether L^ = g{‘i^) for 
some or all k > 8] the question is whether or not there exists a set of vertex- 
disjoint cycles in whose lengths are given by the maximizing partition of 
2 ^. 
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k 

Lk 

1 

2 = 2 

2 

4 = 4 

3 

12 = 3 - 4 

4 

140 = 4 ■ 5 ■ 7 

5 

5460 = 3 ■ 4 ■ 5 ■ 7 ■ 13 

6 

2042040 = 3 ■ 5 ■ 7 ■ 8 ■ 11 ■ 13 ■ 17 

7 

7216569360 = 5 ■ 7 ■ 9 ■ 11 ■ 13 ■ 16 ■ 17 ■ 19 ■ 31 


Table 1: Maximum values of lcm{|Ci|,..., |C„|} for Ci,..., Cn vertex disjoint 
cycles in Gk- 

5 Minimal entropy extensions 

In this section we consider TI extensions /i of /i^ with hnite total entropy, 
where the total entropy of any TI measure /i on X is dehned by 

S{n) = lim S{7rjn), ( 22 ) 

j^oo 

with the entropy S{7ijn) given by (6). The TI extensions described in The¬ 
orem 6 clearly have hnite entropy. We begin with a partial converse. 

Lemma 11 Every TI measure p on X with finite total entropy is a PC 
measure. 

Proof: Let /i be a TI measnre on X. Since any conhgnration p with fi{p) > 
0 must be periodic, p, is atomic if and only if it is a PC measnre. Snppose then 
that p is not atomic, so that p = tpa + {l — t)pb with 0 < f < 1 , /ia an atomic 
probability measnre, and pb a nonatomic probability measnre. Because pb 
is nonatomic there must exist, for any n > 1, a partition X = Ai with 
the Ai measnrable sets satisfying pb{Ai) = 1/n [14, p.l74]. Then one can 
approximate the A^ arbitrarily closely by disjoint cylinder sets A[, where for 
some large iV, A[ = with Bi C X[_ 7 v,Ar]- In particular, one can 
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make this approximation sufficiently close that 


5'(7r[_Ar,7V]h6) N,N]fJ^b){Bi) log(7r[_Ar,jv]/ife)(5i) 

i=l 

1 ” 

> “2 X]/^b(A)log/ife(kli) (23) 

i=l 

= -logn. 

2 ^ 

Thus Hb and hence also jj, does not have hnite (total) entropy. ■ 

Now let /ifc be a LTI measure on from Lemma 11 and the discussion 
in Section 4.1 we know that every hnite entropy extension z/ of /i^ has the 
form 

z/ = ^ Cpz/^,, cp > 0, ^ cp = 1, (24) 

T r 

where the sum is over some collection of minimal closed paths in Gk- Note 
that the BPC measure z/-p has entropy Si^up) = log \V\ and that the measure 
z/ of (24) has entropy 

= '^cp(\og\V\-logcp). (25) 

Theorem 12 Let Hk be a LTI measure on Xk- Then Hk has at least one 
(TI) extension of minimal entropy of the form 

2k 2*= 

fi = '^CiVCi, Q > 0 , ^Cfc = l, (26) 

2=0 2=0 

for some cycles Cq, , C 2 '' Gk. 

Proof: We will hrst show that an entropy minimizing extension exists, then 
that there is such a measure with the form (24) having cp > 0 only if P is a 
cycle, and hnally that there is such a minimizing measure which is a convex 
combination of at most 2^ + 1 measures z/^, with C a cycle. Let M be the 
space of all TI probability measures on X which extend Hk- Then, in the 
weak topology, M is compact and moreover (22) exhibits S as the increasing 
limit of functions continuous on M; thus S is lower semi-continuous on M 
and so achieves its minimum there. Each minimizing measure will have the 
form (24). 
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Now we show that there is a minimizing measure in the form (24) for 
which each closed path appearing with nonzero coefficient is a cycle. To do 
so we note that among all the minimizing measures we can choose one, say 

h = cp > 0, ^ cp = 1, (27) 

V V 


which contains, among the (minimal) closed paths V with c-p > 0, the max¬ 
imal number of cycles. Then in fact all the V in (27) for which cp > 0 must 
be cycles. For if there is some such path V which is not a cycle it may be 
decomposed into a cycle C and some remaining path V' edge-disjoint from 
C. If now in (27) we make the replacement 


C'pl^'p 


\v\ ^ \v\ 


C-pV-pf 


(28) 


then TTfc/i is unchanged and a simple computation shows that S{jl) does not 
increase. By choice of jl, then, C must appear in (27) with positive coefficient. 
But then the same computation shows that S{p,) must strictly decrease under 
(28), contradicting its minimality. 

To complete the proof we suppose that N is the minimum number of 
cycles needed to express an entropy minimizing extension of /i^ in the form 
p = cti > 0, assume that N > 2^ + 1, and derive a contradiction. 

Now certainly and it then follows from the proof in [13] 

of the Caratheodory result mentioned in Remark 7(b) that (possibly after 
renumbering the cycles) we may also write for some 

nonnegative coefficients a*. Set = 0 and consider the measure 


N 

flit) = ^ ai{t)uci, ttiit) = (1 - t)ai + ta*, (29) 

i=0 


and let [u, 1], with u < 0, be the maximal interval such that ai{t) > 0 for 
i = 0,..., N if t E [u, 1]. Note then that nkfl(t) = fik for t G [u, 1] and that 
the entropy S{jl{t)), which is concave in t, achieves its minimum at t = 0, 
and hence is constant. Thus S'(/i(l)) = S'(/i), contradicting the minimality 
of iV. ■ 


Remark 13 (a) The argument of the second step in the proof of Theorem 12 
may be used to strengthen the conclusion expressed in (24) by showing that 
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in fact every entropy minimizing extension of must be a finite convex 
combination of BPC measures. 

(b) From (25) and (26) it follows easily that the entropy of a minimal entropy 
extension of /i^ can be at most ( 2 ^ + l)[log 2 ^ + log( 2 ^ + 1 )]. 

Theorem 12 reduces the search for a minimal entropy extension of a given 
Hk to a hnite problem: for each set of 2 ^ +1 cycles in Gk one tests whether 
is a convex combination of the measures Tik^c for cycles C in that set; if it is, 
the coefficients are uniquely determined and one may compute the entropy 
of the corresponding combination of the One then chooses the minimum 
entropy among the latter. However, this is not practical for k very large, and 
we have no better approach at the moment. 

There is, however, one case in which the minimal entropy extension of fik 
may be obtained explicitly. Suppose that is such that there is a bijective 
measure preserving mapping —)■ which for each vertex ^ of G^, 

^ G Xk-i, maps the set of edges entering ^ to the set of edges leaving that 
is, 0({O.^, 1.^}) = Then determines a set of pairwise edge-disjoint 

paths Vi, ... ,Vn by the condition that if r]^^\ ...,the edges of Vi 
in order then pb+i) = 0 (r/b)j^ j = 1, ..., \Vi\ — 1, and (;/)(? 7 ‘^l^*li) = r]^^\ Now 
because 0 is measure preserving, gives equal weight to the edges of each 
Vi, and thus the measure '^^=lU]i\Vi\l'■p^, where Wi = Hkij}) for any edge rj 
of Vi, is an extension of Hk with the same entropy as Hk and is thus the 
minimal entropy extension. This is precisely the case in which /i^ has a TI 
extension that is {k -|- l)-deterministic, in the sense that is is supported on 
conhgurations that are determined by any segment of length k + 1. 

A special case of the above occurs when Hk is supported on a set of pair¬ 
wise vertex-disjoint cycles Ci,... ,Cn', this means that for each vertex of Gk 
at most one incoming and one outgoing edge is assigned positive probability 
by /ifc. Then jj,k has the unique TI extension ^i\(^iWci, with Wi as above. 
In particular, the maximal entropy extension of Section 2 and the minimal 
entropy extension of Theorem 12 are the same. The total entropy of the ex¬ 
tension is the entropy of Hk, so that one sees from (7) (or directly) that this 
is also the entropy of the restriction Hk-i of pfc to Xk-i. The TI extension 
in this case is /c-deterministic. 

Remark 14 One might try to obtain a minimum entropy extension of ^k 
by a step-by-step procedure, extending first to a measure fik+i on Xk+i, then 
to /ifc +2 on Xk+ 2 , etc., choosing at each step the minimum entropy extension 
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for that step. In fact, there is a simple algorithm for each single step, but the 
procedure may not produce the extension with the minimal total entropy, 
even for the case k = 2. We omit details. 


6 Nonextendible LTI measures 

In this section we give examples to show that the local invariance condition 
(LTI or, for the Bethe lattice, LI) is in general not sufficient for extension 
to an invariant measure, unless A is an interval in Z, a strip in Z^, a higher 
dimensional analogue of the latter, or a full subgraph of the Bethe lattice. 

Example 15 (a) Let A = {0,1,3} C Z and 12 = {o,»}, and suppose that 
/iA assigns probability 1/2 to each of the two conhgurations (•, •, ■ , o) and 
(o, o, • , •). Then /ta is LTI but does not even have a LTI extension to the 
interval (0,1, 2, 3}, and hence not a TI extension to Z. 

(b) We may give a similar example for the Bethe lattice, again with 12 = 
{o,«}. In the notation of Section 3 we take q = 2 and let H be one of 
the connected subgraphs of T 2 with three vertices. Then the measure which 
assigns probability 1/4 to each of the conhgurations and 

is LI but does not extend to an LI measure on X 2 . 

Note that when A C Z and A^ is the minimal interval containing A, the 
extendibility of an LTI measure from Xa to which is necessary and, by 
Theorem 1, sufficient for extendibility to X, may be determined by solving 
a standard linear programming feasibility problem. If iL is a hnite subgraph 
of T then a similar remark applies to the extension of an LI measure from 
Xh to Xr, where T is the minimal full subgraph of T containing H. Thus 
the problem of extension in one dimension, or on the Bethe lattice, is decid¬ 
able; this is in contrast to the situation in higher dimension, as discussed in 
Section 7. 

Example 16 Let A be a 2 x 2 square in Z^, let 12 = (o, •}, and let /i be 
the measure which assigns probability 1/4 to each of the conhgurations 
i = 1,... ,4, shown in Figure 3. fi is LTI, since the marginal on the top, 
bottom, left, or right two sites of A is Bernoulli with parameter 1/2, but /x 
cannot be extended to a measure /i' on conhgurations on a 3 x 3 square A' 
containing A. For suppose that /x' is such an extension; fi' can give positive 
probability to a conhguration rf' only if the restriction of r]' to each of the four 
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2x2 subsquares of A' is one of the r]^^\ Moreover, there must be an t]' with 
> 0 having restriction to the lower left subsquare, and r]' must then 
have restrictions and 77 *-^^ to the upper left and lower right subsquares, 
respectively. But then the restriction of 77 ' to upper right subsquare will not 
be one of the 77 ^*^, whether or not the upper right hand site of A' is occupied 
in 77 '. 
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• 

0 
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0 
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(1) 

T] 

(2) 

V 

( 3 ) 

T] 

( 4 ) 


Figure 3: Configurations given nonzero probability in Example 16. Filled 
circles represent occupied sites. 

The measure fx in Example 16 is not invariant under any of the symmetry 
operations of the square; one could hope that the imposition of some sym¬ 
metry might give extensibility. The next example shows that this is not the 
case. 

Example 17 Let A be a 3 x 3 square in 1? and let fx be the measure which 
assigns probability 1/7 to each of the conhgurations 77 ^*^ 7 = 1,..., 7, shown 
in Figure 4. fx is easily seen to be LTI and is clearly invariant under any 
symmetry of the square. However, jx, cannot be extended to any 4x4 square 
A' containing A. The proof is similar to the proof of nonextendibility given 
in Example 16: one checks, for example, that there is no conhguration 77 ' in 
A' which reduces to 77 ’-^^ in the lower left hand 3x3 subsquare and to one of 
the 77 ^*) in all the other 3x3 subsquares. 
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Figure 4: Conhgurations given nonzero probability in Example 17. 


The measures in the above examples appear rather special, in that they 
assign zero probability to most conhgurations. Recall from Section 1, how¬ 
ever, that the set of nonextendible measures (for hxed A) is open; thus small 
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perturbations of these measures will also be nonextendible. Such perturba¬ 
tions may be taken to assign nonzero probability to every conhguration in A, 
to be be again LTI, and, for Example 17, to have all the symmetries of the 
square. 


7 Undecidability 

As discussed above, the situation in 1/“ for d > 2 is quite different from 
that for d = 1 or for the Bethe lattice. In particular, there is no formula 
similar to (4) or (13) for an extension, and the LTI condition is not sufficient 
for extendibility. More surprisingly, the extendibility problem for 1/ with 
d > 2 is in several senses undecidable. To discuss this we introduce the idea 
of tiling. It suffices to £x A to be a 2 x 2 box in Z^, and we will do so 
throughout this section. Let E be a hnite subset of Xa = constructed 
with some hi; we call the elements of Y tiles and say that Y tiles the plane 
if there is a configuration in X whose restriction to every 2x2 box is an 
element of Y. Here we do not consider H as fixed, so there is an infinite 
number of possible sets Y of tiles; given Y we will consider only tilings by Y, 
so that for all practical purposes Y determines H, and we will omit mention 
of the latter in what follows. Berger [3] proved: 

Theorem 18 The tiling problem is undecidable: there is no decision pro¬ 
cedure which, given a set of tiles Y, determines whether or not Y tiles the 
plane. 

The statement of the theorem means that there is no algorithm (or Turing 
machine) to which we can submit a tile set Y and which will then yield the 
result “tiles” when Y in fact tiles and “does not tile” when it does not. Note 
that it is crucial here that the set of possible tile sets Y be infinite, since 
otherwise there would exist such a decision procedure, though we might not 
know what it is: if there were N tile sets Ti,..., Y^ then it would be one of 
the 2^ procedures which answer the N questions “Does Yk tile?” in all 2^ 
possible ways. 

We should remark that Berger worked with a different sort of tile, origi¬ 
nally introduced by Wang [32], but it is easy to see [30] that his result implies 
the above theorem. A simplihed version of the proof of Berger’s theorem is 
due to R. M. Robinson [25]. 
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There is an alternative formulation of undecidability which follows from 
Berger’s result. 

Corollary 19 There exists a set of tiles Y* such that y* tiles the plane but 
cannot he proved to do so. 

Proof: It is known [25] that if Y does not tile the plane then there is some 
hnite rectangle which it does not tile, so that the fact that Y does not tile 
is provable. Thus if the conclusion of the theorem were false an algorithm 
generating all provable theorems would provide a decision procedure for the 
tiling problem. ■ 

It should be noted that Corollary 19 is not really stated precisely; whether 
or not Y can be proved to tile depends on the axiom system on which the 
proof is to be based. In fact, however, a tile set P* satisfying the theorem 
will always exist, but will in general depend on the (consistent and sound) 
axiom system chosen. 

Schlijper [30] observed a connection between the tiling problem and the 
extendibility of measures: 

Theorem 20 (Schlijper) A set of tiles Y tiles the plane if and only if there 
exists an extendible measure z/y on Xa with support Y. 

Then an undecidability result follows: 

Corollary 21 There is no decision procedure which, given a set of tiles Y, 
determines whether or not there exists an extendible measure z/a on Xa with 
support Y. Equivalently, there is no decision procedure which, given an LTI 
measure on X\, determines whether or not there exists an extendible 
measure z/a on Xa with the same support. 

This result certainly suggests that there should be no decision procedure 
for our original problem of determining whether or not a given LTI measure 
Pa is extendible, that is, that this problem is undecidable. However, since 
most of the measures pa are presumably not expressible—not computable— 
most cannot in fact be “given” to the decision procedure to begin with. 

Nevertheless, Corollary 21 does lead to a conclusion which furnishes a 
strong sense of undecidability for the original problem. Suppose there were 
a condition C for extendibility which was “useful”, that is, simpler and more 
transparent than extendibility itself—perhaps something in the nature of the 
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LTI condition (although of course we know that this is not a such a condition 
for d > 2). No matter how simple C were, however, there could exist no 
decision procedure which, given a set Y of tiles, would determine whether or 
not there exists a measure z/a on Xa with support Y which satisfies C. 

Another formulation of undecidability for the extension problem, alter¬ 
native to Corollary 21 in the sense that Corollary 19 is alternative to Theo¬ 
rem 18, follows immediately from Corollary 19 and Theorem 20; 

Corollary 22 There exists a set of tiles T* sueh that (1) there is an ex¬ 
tendible measure ua onXA with support Y^, but (2) this faet eannot be proven. 

Here, as for Corollary 19, H* will in general depend on the axiom system to 
be used in the proof. It of course follows from Corollary 22 that if we specify 
a measure on Xa with support H* to arbitrary but not perfect precision— 
that is, specify that it lie in some arbitrarily small set of measures—then 
for some such specification there exists an extendible measure satisfying it 
whose existence can’t be proven. This suggests that there exists an extendible 
measure ua on Xa for which the proposition that it is extendible can’t be 
proven. However this is not so clear, since the relevant measure may not be 
suitably expressible and thus the desired proposition may not exist. 

As with Corollary 21, however. Corollary 22 does have a consequence 
which strongly suggests undecidability for the original problem: if there were 
a condition C for extendibility, “useful” in the sense discussed above, then 
the statement that there exists a measure with support H* which satisfies C 
would be true but unprovable. 

Acknowledgments. The work J.L.L. was supported in part by NSF Grant 
DMR 1104500 and AFOSR Grant FA9550-16-1-0037. We thank A. G. D. 
van Enter and M. Hochman for bringing to our attention previous work on 
this problem, M. Hochman, M. Saks, S. Thomas, and A. G. D. van Enter 
for helpful discussions, and D. Avis for making the computer program Irs 
available to the public and for helpful advice on its use. 


References 

[1] Ambartzumian, R. V., and Sukiasian, H. S., Inclusion-exclusion and 
point processes. Aeta Appl. Math. 22, 15-31 (1991). 


25 



[2] Ash, R. B., Real Analysis and Probability. Academic Press, New York, 
1972. 

[3] Berger, R., The undecidability of the domino problem. Mem. Amer. 
Math. Soc. 66 (1966). 

[4] Caglioti, E., Kuna, T., Lebowitz, J. L. and Speer, E., Point processes 
with specihed low order correlations. Markov Processes Relat. Fields 12 
257-272 (2006). 

[5] Caratheodory, C., Uber den Variabilitatsbereich der Fourierschen Kon- 
stanten von positiven harmonischen Funktionen. Rend. Circ. Mat. 
Palermo, 32, 193-217 (1911). 

[6] Chazottes, J.-R., Gambaudo, J.-M., Hochman, M., and Ugalde, E., On 
the hnite-dimensional marginals of shift-invariant measures. Ergod. Th. 
& Dynam. Sys. 32, 1485-1500 (2012). 

[7] Crawford, J., Torquato, S., and Stillinger, F. H., Aspects of correlation 
function realizability, J. Chem. Phys. 119, 7065-7074 (2003). 

[8] de Bruijn, N. G., A Combinatorial Problem. K. Ned. Akad. van Wet. A 
49, 758-764 (1946). 

[9] Dudley, R. M., Real Analysis and Probability. Cambridge University 
Press, New York, 2002. 

[10] Georgii, H.-O., Gibbs Measures and Phase Transitions, Second Edition. 
DeCruyter, Berlin/New York, 2011. 

[11] Golomb, S. W., Shift Register Seguences, Revised Edition. Aegean Park 
Press, Laguna Hills, 1982. 

[12] Good, I. J., Normal recurring decimals. J. London Math. Soc. 21, 169- 
172 (1946). 

[13] Griinbaum, V., Convex Polytopes, Second Edition. Springer-Verlag, New 
York, 2003. 

[14] Halmos, P. R., Measure Theory. D. van Nostrand, Princeton, 1950. 


26 



[15] Costin, O., Kuna, T., Lebowitz, J. L., and Speer, E., On the realizability 
of point processes with specihed one and two particle densities. In C. 
Landim, S. 011a, and H. Spohn, Math. Forsch. Oberwolfach 43, Large 
Scale Stochastic Dynamics (2004). 

[16] Kuna, T., Lebowitz, J. L. and Speer, E. Realizability of point processes. 
J. Stat. Phys. 129 417-440 (2007). 

[17] Kuna, T., Lebowitz, J. L., and Speer, E., Necessary and sufficient con¬ 
ditions for realizability of point processes. Ann. Appl. Probab. 21, 1253- 
1281 (2011). 

[18] Lachieze-Rey, R. and Molchanov, L, Regularity conditions in the realis- 
ability problem with applications to point processes and random closed 
sets. Ann. Appl. Probab. 25, 116-149 (2015). 

[19] Landan, E., Uber die Maximalordnung der Permntationen gegebenen 
Grades. Arch. Math. Phys., Ser. 3 5 92-103 (1903). 

[20] Lieb, E., Some convexity and snbadditivity properties of entropy. Bull. 
Amer. Math. Soc. 81, 1-13 (1975). 

[21] Maurer, U. M., Asymptotically-tight bounds on the nnmber of cycles in 
generalized de Bruijn graphs. Disc. Appl. Math. 37/38, 421-436 (1992). 

[22] Pelizzola, A., Cluster Variation Method in Statistical Physics and Prob¬ 
abilistic Graphical Models. J. Phys. A 38 R309-R339 (2005). 

[23] Percus, J. K., The pair distribution fnnction in classical statistical me¬ 
chanics, in The Equilibrium Theory of Classical Fluids, ed. H. L. Frisch 
and J. L. Lebowitz. New York, Benjamin, 1964. 

[24] Pivato, M., Building a stationary stochastic process from a hnite- 
dimensional marginal. Canad. J. Math 53, 382-413 (2001). 

[25] Robinson, R. M., Undecidability and nonperiodicity for tilings of the 
plane. Invent. Math. 12, 177-209 (1971). 

[26] Ruelle, D., Thermodynamic Formalism: The Mathematical Structures of 
Classical Equilibrium Statistical Mechanics. Addison Wesley, Reading, 
1978. 


27 



[27] Schlijper, A. G., Convergence of the cluster-variation method in the 
thermodynamic limit. Phys. Rev. B 27, 6841-6848 (1983). 

[28] Schlijper, A. G., Exact variational methods and cluster-variation ap¬ 
proximations. J. Stat Phys. 35, 285-301 (1984). 

[29] Schlijper, A. G., On some variational approximations in two-dimensional 
classical lattice systems. J. Stat Phys. 40, 1-27 (1985). 

[30] Schlijper, A. G., Tiling problems and undecidability in the cluster- 
variation method. J. Stat Phys. 50, 689-714 (1988). 

[31] Stillinger, F. H., and Torquato, S., Pair correlation function realizability: 
lattice model implications, J. Phys. Chem. B 108, 19589 (2004). 


[32] Wang, H., Proving theorems by pattern recognition-II. 



